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Eigenvalues of Sums of Hermitian Matrices. III. 

Robert C. Thompson and Linda Freede Garbanati** 

November 2, 1971 

Two classes of nonlinear inequalities for the eigenvalues of sums of Hermitian matrices are 
obtained. These nonlinear inequalities are shown to follow from linear inequalities established in 
parts I and II of this series. A new inequality for the singular values of matrix products is also obtained. 
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1. Introduction. 

Let C = A-\-B where C, A, B are Hermitian matrices. In recent years a number of inequalities 
have been established linking the eigenvalues of C, A, B. For the most part these inequalities are 
linear, but a number of nonlinear inequalities are also known which involve convex or concave 
functions of the eigenvalues. Generally speaking, the methods used to derive the linear inequalities 
work equally well in deriving these nonlinear inequalities. These methods are based on the extremal 
properties of eigenvalues or on induction and the Cauchy interlacing inequalities. A defect of 
the use of these methods when deriving nonlinear inequalities is that they do not clarify whether 
the nonlinear inequalities are consequences of the linear ones. There is, however, a third method 
which derives nonlinear inequalities from linear ones. It is the purpose of this paper to use this 
third method to obtain several new families of nonlinear inequalities for the eigenvalues of matrix 
sums. It will turn out that our new inequalities include as a special case a generalized and sharp- 
ened version of an inequality recently proved by Marcus [2). 1 We shall also derive a previously 
unnoticed inequality for the singular values of a matrix product. 



2. The Main Results for Sums 

Theorem 1: Let integers ii, . . .,i m ,ji, . . ., j m satisfy 

l^ii<. . .<i m ^n, l^ji<. • . <j m ^n, i m + j m -m^n. 
Set 

ks = is + js-s for s = l,. . .,m. 
Let 0^ 6 ^ 1, 0-\-<p=\ and let A, B, C = 8 A + <£>B be n-square Hermitian matrices with eigenvalues 

a,^. . .>afa,j3i>. . .^j3 n ,yi^. . .*y nf (1) 
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respectively. Let f(xi, . . ., x m ) be a real-valued function, convex, symmetric, and nondecreasing in 
each x t for (xi , . . ., x m ) lying in the va- dimensional hypercube J X . . . X J> ', where J> is the interval 

J> = [min (a n , j8 n ), max («i , /3i)] . 

Then 

{(y kl . . ., y kl ) ^ Bi{a iv . . . , aj + <pi{fi h , . . .. ftj. (2) 

PROOF: The inequality 

m m m 

XrA-^S^+'pS/^ (3) 

s=l s=l s=l 

is known [7 , Theorem 1 ] . Applying this for r in place of m, we have 

2****2 «<. + *i/ a, .fc' r=1 >- • -' m - 

s=l s=l s=l 

If we let 

c s = y ks ,d s =0a is + (p(3 js , 5=1,. . .,m, 

then Ci ^ . . . ^ c m , c?i ^ . . . ^ d m , and Ci + . . . + c r ^ d\ + . . . + d r for 1 ^ r ^ m. These con- 
ditions are known [5, Theorem 15] to imply that/(ci, . . ., c m ) ^f{d\, . . ., dm). From this (2) 
is immediate. 

This proof uses only standard techniques. Rather more interesting and surprising is that these 
same techniques can be used to establish the inequalities of the next theorem. 

Theorem 2: Let C = 6A-\-<pB and f be as in Theorem 1. Let Zi, . . ., Z n _ m , Wi, . . ., W n _ m 
be integers satisfying 

Zr^ . . . ^Z n _ m ^m, W^ . . . ^W n _ m ^m, Zj + W^m. 

Let 5 x (y) be a jump function; 8 x (y)= 1 ify > x and 8 x (y)= ify ^ x. Let 

I s =s + S Zl (s)+ . . . +8 Zn _ m (s), 

J s = s + 8 Wl (s)+ . . . + 8w n _ m (s), 

K s =s + 8 Zl+Wl _ m (s) + . . . +8 Zn _ m+Wn _ m _ m (s), s=l, . . ., m. 
Then 

f(7Ki, • • .,7K m )^^K, . . .,a Im ) +#(&!, . . .,j8 Jm ). (4) 

PROOF: The following inequality is known: 

m m m 

2yA- s ^2 a ' S +4 > 2Av (5) 

s=l s=l s=l 

This inequality may be obtained from Theorem 4 of [8] by using 6\r*(y) = d x -i(y). In order to prove 
(4) we need to show that 

2y***2 tt * + *2&.- < 6 ) 



s=l 
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holds for each r= 1, . . ., ra.For if this is so then the proof of Theorem 1 applies here also. Define 
nonnegative integers u and v by 

Z,^. . . ^Zu^r<Z u+ i^. . .^Z„_ m , 

W x ^ . . . ^ W v ^ r < W M ^ . . . ^ 0V m . 

Without loss of generality let a ^ t;. Define £1 ^ ... ^ gn-r<> 
coi ^ . . . ^ o) n -r by 



(7) 



gi=Zi — (m — r), . . .,ft< = Z w — (m — r), £«+i — r, . . .,£ n _ r = r, 
coi = JFi, . . .,co r = W v ,<i) v+l = r, . . .,w„- r =r. 
Then also £i + ooi ^ r. Set 

P 8 = 5+8^(5)+. . .+8^_ r (s), 

(^s + S^ (5) + . . . + 8 OJ „_ r (5), 

R s =S-\-d£ l+lol -r(s) + . . . + 0>„_ r+( o„_ r -r(s), 5=1, . . . , T. 

Writing down the inequality (5) with r in place of m we have 

ir^cS^+^ft, (8) 

s = 1 8 = 1 s = 1 

Now for 5 ^ r we have 

p= 1 p = 1 p= 1 

because 

°V p (s) =0 for 5 ^r and p>u; 
&€p(s) = 8z p -(m-r) (s) ^ 3 Zp (s) for p^ w. 
For s^rwe have 

n-r v v n-m 

p= i p = i p = i p = i 

since 

8 O)p (s)=0 = 8 Wp (s) for p>z;. 
Furthermore, for s ^ r (using Z p +JFp-m=£ p H-cOp-r for p^ w «rcd Z p -/n+r^o) p for all p) we 
have 

P=l p=M+l p=l p=l/+l 

P= 1 p=u+l 
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Thus, for 5=1, . . ., r, we have P s ^ h, Qs = Js, K S ^R S > From this it follows that (6) is a con- 
sequence of (8). This completes the proof. 

Remark 1: In fact we have proved that if f{x u . . ., x r ) is convex, symmetric, and non- 
decreasing then 

f(y Kl9 . . ., y Kr ) * 0f(a Il9 . . ., ai r )+(pf(fij 19 . . ., pj r ) for r ^ m. (9) 

That the inequality (9) for r< m is valid is a new result even when /is linear. 
As a consequence of theorems 1 and 2, we obtain theorems 3 and 4. 

THEOREM 3: Let A, B, C be as in theorem 1. Let g(xi, . . ., x m ) be a real-valued function, 
symmetric, convex, and nonincreasing in each variable when (xi, . . ., x m ) eSX . . . X3. Le£ 
i{, . . ., i m , j(, . . ., j m , k(, . . ., k m be integers with 

1 ^ i{ < . . . < i' m ^ n, 1 < j{ <...<&* n, il + jj > n + 1 - m, 

kg = ig -h jg — s + m — n, 1 ^ s ^ m. 

Then 

g(7ki» • - •» k' m ) ^ Og(ay v . . ., a Vm ) + <pg(Py v . . ., /3y m ). 

Theorem 4: Let A, B, C, g be as in theorem 3. Let integers ZJ, . . ., Z n _ m , WJ, . . ., Wn_ m 
satisfy 

o^z;^...^z' , o^w;^...^w , z' +w ^m. 

1 n-m' 1 n-m' n-m n-m 

Let 

n-m n-m 



K^ = s+2 8 z' p +w; (s), s=1,. . ., m. 
p-i 

Then 

g(7Ki» • • -i Tk'J ^ 0g(<*ii> -.., arj-f^g^ji, • • -, ftr m ). 

PROOF: Let /(^i, . . ., # m )=g(— #1, . . ., —x m ) and apply theorems 1 and 2 to— C=0(—A) 
-\-ip{—B). This yields theorem 3 in a straightforward manner. To obtain theorem 4 take Z s =m 
— Z'm+is and use 1 — d z (m+ 1 —5) = 8 m - z (s). 

From theorems 1-4 we deduce 

F(yk„. ■ .,y km )^6F(a u ,. . .,a, m )+^F(/3 J1 , . . .,ft m ) 

F(y*,,. • .,yA m )^0F(«,„. . .,«,„,) +v>F(/3, , frj 

G(y ki „. . .,y km ,)>dG{ aii „ . . .,a im ,)+<pG(^,, . . ..fa) 

G(y Kl „. . .,y Km ,)^6G{ ai ,,. . ., a, m ,) + <pG(fr f „ . . ., /3, m ,) 
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where F is symmetric, concave, and nonincreasing on/X. . . X J> , and G is symmetric, concave, 
and nondecreasing on/X. . .X/. One merely applies Theorems 1-4 to/= — F and g = — G. 

Remark 2: Let ,4, B be positive definite and set C = A+B. Letg(^i, . . ., x m ) = ^f 1 4- . . . 
+ *m 1 - Writing C = i(2^) + i(2Z?), we obtain from theorem 3 the inequality 

m m m 

^Srv-^Sav-'+S^'" 1 - ( 10 ) 

8= 1 .S- 1 8= 1 

In particular if we take i' s = s and f 8 = n — m + s, for 5=1,. . . , m, then (10) becomes 

m m m 

S=\ S=\ 8=1 

If in theorem 4, we set Z[ = . . . = Z' n -m = m, W\ = . . . = W' n - m = and use this same g we ob- 
tain (11). The inequality (11) is clearly sharper than the inequality 

m m m 

zJw^Sfl^ + SjfcW (12) 

,s-= 1 ,s- 1 8= 1 

The inequality (12) was proved in [2] under the additional hypothesis m ^ n/2. Thus theorems 3 
and 4 both substantially generalize and sharpen theorem 2 of [2J. 

By further specializations of theorems 1 and 2 many additional nonlinear inequalities may 
be written down. In particular many of the results in [3, chap. 2], [4|, [10, p. 1 10] may be generalized. 

Remark 3: If in theorems 1 and 2, we let A, B, C = 0A + <j>B be not necessarily Hermitian 
matrices and we let the numbers (1) denote the singular values oiA, B, C respectively, then the con- 
clusions of theorems 1 and 2 remain valid. This is because the inequalities (3) and (5) are known to be 
valid for the singular values of matrix sums. By this type of device many of the singular value 
inequalities in [1 , chapter 2] and [4] may be be substantially generalized. 

Remark 4: The results of theorems 1 and 2 are used in [6]. 

3. A new inequality for the singular values of a matrix product. 

THEOREM 5: Let A, B, C = AB be a product of not necessarily Hermitian matrices. Let (I) 
deonote the singular values of A, B, C respectively. Let I s , J s , K s denote the integers defined in 
theorem 2. Then 

m m 

2 Tk s -S 2 a 's&s- (13) 

s=l s=l 

PROOF: The inequality 

m m 

n y* * n *./3/. 

is known [9J. As in the proof of theorem 2 it implies 

8= 1 .S- 1 
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for each r=l, . . .,m.//we set 

c s = log y Ks , d s = log a Is /3 Js 

thenci + . . . + c r ^di-h. . . + d r forr=l, . . ., m. The function f(xi , . . ., x m ) = exp Xi-K . . + 
exp x m is convex and increasing and hence exp Ci + . . . + exp c m ^ exp di + . . . -f- exp d m . This 
immediately yields (13). The inequality 

m m 

s=l s=l 

is also true and was proved by the same method in [9]. 
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